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ABSTBACT 

The document reports' an outside evaluation of a 
Niagara Falls Adult Basic Education Program special project entitled 
••Identification of Preferred Cognitive Styles and Matching Adult 
Beading Program Alternatives for the 0*4 Grade levels. •■ It vas 
concerned with (1) research, training in cognitive style mapping, and 
development of a survey and process vhich vould assess the adult 
student's preferred cognitive style, for prescribing individualized 
instruction; and (2) development of a taxonomy of alternative reading 
programs, methods, and materials presently available at the Niagara 
Falls center, as a resource file for matching materials vith 
individual students* developmental levels and cognitive styles. The 
report's five sections are: (1) a description of the evaluation 
procedure, the Provus Discrepancy Model; (2) a list of 11 project 
objectives and accomplishments; (3) breakdowns by race, sex, and 
educational level of students, in the areas of symbolic orientation, 
cultural determinants, and modes of inference; (4) an evaluation of 
the cognitive style-mapping instrument; and (5) an evaluation of the 
total project, including recommendations. The staff accomplished most 
of their objectives, became skilled in the theory and application of 
cognitive style mapping, trained other personnel, and developed an 
effective instrument for assessing learning style preferences. A 
map-analysis form is appended. (Author/AJ) 
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State University of New York at Buffalo 



DEPAUrMKNT OP E!.KMKNTARY AND RKMUDIAL EDUCATION 

ProKToniH in fulemcntary Kducalion. Kcndinv. KcmcilinI Kducalioii mnd Karly Childhood 



FACULTY OF KDUCATIONAL STUDIES 



December 19, 1975 



Dear Mr, Franciosa, 

Enclosed you will find the completed evaluation of your 
HEW 309 project on Congitive Style Mapping. As discussed 
before, the procedure used was the Provus Discrepancy Model 
which essentially provides a reality testing of what was 
stated in the proposal and what was actually accomplished. 

Additionally, I have provided a description of the de- 
mographic information of the participants, suggestions by 
Program Directors who were involved in the project, and a 
description of those students in Niagara Falls cognitive 
styles. 

It was a pleasure working with you and your staff and, 
I hope you will find the suggestions I made helpful as you 
continue the implementation of your program. 



Sincerely, 




Elois M, Skecn 
Assistant Professor 
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INTRODUCTION 

This report Is divided In five ma;) or so-ctlons. The first 
section describes the Trovus Discrepancy Model which is the 
evaluation procedure used in this report. The second section 
lists all of the objectives included in the funded proposal and 
describes the extent to which each v;as accomplished. The third 
section provides a breakdown by race, sex and educational level 
of those students with major orientations in the areas of S ymbolic 
Orientation, Cultural Determinants , and M odes of Inference , The 
fourth section is an evaluation of the Cognitive Style Mapping Tnstru 
cient and the fifth and last section is an evaluation of the total 
project including recommendations. 
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■ KVAl.UATION I'llOCUDUllK 

« 

Tho Provus Discrepancy Model consists of. a five stago evaluation 
process to assess (:ho "discrepancy^* of initially stated profpram Ronls 
and objectives to the implementation of these Roals and ohjoclives 
in the installation of the program in tho field and finally to the 
end products achieved by the program. Additionally, this process 
can assist in characteri^.ino the varying developmental aspects and 
process of programs. Ideally, this mcdol works best when an 
evaluator is included initially in the development of a new pro- 
gram so that ^/he might provide input in each stage to the program 
staff in order to facilitate the congruence of initially stated 
goals and objectives to terminal output. 

Following is a brief description of the five stages to be 
evaluated (Frovus, 1971). 

D esi^;n 

During the design stage one develops and specifies the major 
goals of the program and the methods used to obtain those goals. 
An effective evaluation of this stage requires that both the 
structural and ihcoretical soundness of the proposed goals be 
evaluated. This process can be diagramed 'in the following manner. 

INPUTS - PROCESS ODTPUTS 

^* lUPliy. ^^"^ composed of throe components: variables, pre- 
conditions, and criireria, 

^* Vnri ables essentially vefcr to anything thai; is to 
be changed, for oxainplo, pupil pcrXormnnce, Tho 

variables, listed may include tlioso Cor tho client V.s 
well as those for the staff. 
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P rcnondS. t ionn p rovldc a duwcirlptlon of the catering 
charactoriotica of the clients, the staff or both, 
what chavactcrlr^tJ.cs Kuct people have to be e]i;,ib.l(i for 
this pvojirsm? 

c. Criteria describe how you will select your clients and/or 
your cCaff, thAt is, given certain entering characteristics 
what procedure will you then utili2e to make r.elcctions 
of per£;ons to be included? 



2. Process is ccnpor.ed of two conponcnts: variables and criteria. 

a. Tlie v ariable s in this stage give a description of what 

the clients, students,- staff ctir, will be doinjj. (activities) 



h\ Crilzoriri dcscrilie hov? ciuch tii^e will be c'iivoted on the 
^ QCtivJ.lries deccribsd in the variable section above-, 

3. Outputs include the sane eler.ents as are present in the inpuc ?>tr.<:.e. 
The r*ajor diffcrancc beCxreea the two stages is tliat the criteria 
to bc5 evaluated Six the output stage roTors to the terminal goals 
attained at the e::d of the program. 



Ins tall a t: ion 

This stage cnao::.pasi:er; your first roo.lity of fidelity testing to 
your standard, ej;,, how doer* the progiani in the fiold compare to v;bat 
Is stated to be in the design? Idcnlly, this stage cnntributcs to the 
.dovclopucnt of congruence botoiiin reality and tli:^ .<;tandard by pointing 
up discrepancies and assisting Ihe shift to a more c(m;/juent woJel. 
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Procoss 

In thlo BtaRC one cGsontinlJ.y coinparon the. InterLm producin with 
those specif led In the dcBign. It is assumed tliat at this po.lnt th? 
acquisition of the interim products are both nccesnary to the tcrulur.i 
output' and will as5;ure the achievement of the stated terciinal tjo*\Is. 

Vroducl: 

This stage ii> similar to sttiz^ tl:roe except that cno. locks at the 
congruence of the stated goals in tha design to those obtained nhc*. 
end of the project. la other \;ords, hava you aocoE:pli.';hed vhat yoa 
said you would? 

Cost 

TiD'r. rj'jii^ci is i;otrcv:hat diftLirCiir than the o!:hi?r four stage*-^ prv- 
viously dir.cussicd, in that, in tlia fir?:t four ::rage3 ot;.? Jooks v/it!iir. 
the prograra bein^ Civ^juated. I:; thir> last r?r.<rsr:j one couip.ircs the pro- 
gran boing evalu^.tcc. \7ith othcir i;ir.Jlar pv.ogi'iir/.w . Thi.s coiiparisou attcn: 
to assecc the cost benefit;; of cno progrcin hiiving the so:zq Ktatc-d tctailn 
out:cor.ies to another. 

Al>jM;rcATION OK 'iTii^ PROVUS 1I00-':L W Tira NXACAllA KAILS i^i^OJliCT 
Thi? sectio:; |>rovi.(ics an ovi>rvicw of ti»o coi^pononLs o!' I.hp pro- 
ject aiJ they cllccclly relate to the Trovnr* Discrepancy cvnluacion 
procedure. 
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. Dosi?>n 

Structurally, Lhi« proposal contained more objectives than 
could bo reasonably accomplished for Iho length of ilie program. 
This could not tiave been anticipated initially, but, in January, 
modifications wore submitted to HEW v;hich reflected one of the 
extremely positive aspects of this program v;hich has been a 
constant evaluation of their procedures and progress. In all 
cases, an effort was wade to include the evaluator so that input 
relative to feasibility and theoretical soundness could be 
provided. 

Regarding the tlieoretical aspects of the program, the 

staff has grown tremendously, from initially recognizing a need, 

searching for an objective way to meet that need, to a critical 

evaluation of the development and modification of an instrument. 

The theory that people learn in differ(;nt v;ays v;as never an issue, 

objectively quantifying that information has been, 

!• Inputs (areas in which change will occur) 
A, Variables 

(a) Students 

An increase in reading performance will 

occur as a result of instruction utilizing 
tlio Cognitive Style Mapping (C3M) procedure. 

(b) Staff (includes Niagara Falls staff and 

staff of other AV,E centers in N,Y, Staco) 
Ability to diagnose proferrcid learning style 

using CSM qucsi lonnaire , al)Llity to prescribe 

inslruct:ioM program for eacli studonl* based 

upon Ills diagnosis and the. ability to implement 
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the prescribed proyram. 

B. PrGcoiuli Lions 
(*0 gti Klont s 

Tlie priority enccrlng chnractcristics of the 

V 

students in the target population were: 
(1) 0-4 entering reading level, (2) minority 
(3) male (4) unemployed or underemployed, 
(b) Staff 

Limited or no knowledge of Cognitive Style 
Mapping, 

C, Criteria 

(a) Students 

The students wore selected after thoy voluntarily 

enrolled in ADE programs and were given achieve- 
ment tests to determine reading level. The 
•number of students selected were liuiited to 
the number of trained staff members, 

2 , Process 

A. Variables 

(«) Stude nts 

Tlie students will be learning utilising materials 

in which they can use his/her preferred learning 

mode, 

(b) Staff 

Teachers will [)roscribe these instructional 
materials and grouping procedures for each stu- 
dent based upon the results of the students CSM 
scores, 

B. Criteria 

(a) Studonts 

The proposal was ainend<»d to read approximately 
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* • ,^ " one hundred hours of instruction would bo 

, . . provided for each student. 

3. Outputs (these are essentially the same as stated in 
the Input section) . 

Inst allation 

In addition to Niagara Falls, this project included centers 
in Buffalo, Albany, Schenectady, and White Plains, Staff members 
frora the Niagara Falls project and Oakland University provided 
the needed workshops and inservice programs. Additionally, the 
Niagara Falls staff administered the CSM questionnaire and wrote 
prescriptions for all of the other students tested in each of the 
centers named above. 

rrodu ct 

The Product is described In both the Objectives section of 
this report and the Product Evaluation section for both students and 
staff. 

Cost 

No attempt has been made to provide a cost benefit analysis. 
It is suggested that this stage is premature at this point. 
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EVALUATION OF ACCOMPLISHMliNT OF STATED GOALS AND ObJECTIVKS 

Tliis section describes each of the goals and/or objec- 
tives stat'.ed by the Niagara Falls Center in their initial 
proposal or as modified and approved by HEW, and evaluntes the 
degree to which ihoy have been accomplished. 

O bjective I . To provide Niagara Falls ABE teachers 
with an orientation to Cognitive Style Mapping and to provide 
an intense orientation to Cognitive Style Mapping to ABE 
teachers in New York State. 

(a) Initially, the teachers in the, Niagara Falls day- 
time program received an in depth description of 
the project, its aims and their responsibilities 

. to the program. 

(b) The teachers and the staff that were to be 
directly involved with the implementation aspect 
of the project received an in depth three clay 
training session from the Oakland Conmumity College 
staff. 

(c) After this training period, the Niagara Falls 
project staff then gave a five day training 
session to the total Niagara Falls ABE staff. 

The second part of this objective was accomplished by 
providing: 

(a) A 3-*^ (lay workshof), v;hich was co-sponsored by the 
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New York StaLo Education DcparLmont: Staff DovolopmcMit 
section, v.\is given to representatives of the centers 
which worked with the Niagara Falls group during the 
implementation aspect of this project, local ABE 
staff memhcrs, representatives from the 10 Regions, 
State Education Department and USOE staff members 
were also present. This workshop was {primarily 
informational and served the purpose of a dis- 
semination vcliicle regarding the concept of CSM 
and its implication for the development of 
instructional programs for ABE students* 

(b) Tx-70 follow-up v;orkshops were conducted for 
Schenectady, White Plains, Albany, and Buffalo 
which provided the training needed to administer 
a CSM questionnaire, interpret the findings to a 

1" - 

student, and to prescribe an instructional pro- 
gram to compliment the students individual styles. 

(c) A final v/orkshop was given for the participants 
to discuss the problems they experienced during 
imp Icmcntation. 

O bioctivo 2 > Tlic development of an instrument to be used 
for mr\ppinf', cognitive stylos of A)iK students* 

The .original instrument which the Niagara Falls Center 
oblainod from Oakland University was developed for Junior 
College st\idc*ntK. The Niagara Falls project staff rewrote the 



questions so tluii ilicy had a readability level of approximncoly 
fourth 8"do. Secondly, ihcy put the qiicstiona on language 
master cards so that those students who had reading levels 
below grade four could also participate in the mapping process. 

This caused two problems: (1) The initial rewriting 
of the questionnaire prevented the use of whatever reliability 
and validity infonnation which was available on the instruments 
developed by Dr. Joseph Hill." And, (2) By chancing their own 
questionnaire lo fit the physical constraints of the language 
master card^ they had in ossonce developed two different 
instruments. 

The instrument which they developed followed the format 
of the instrument developed by Dr. Hill in that the staff 
assumed there were 26 major ways in which individuals gain 
information, and these 26 ways comprise three areas which 
reflect the major-minor orientation of students. Two throe 
areas are: (1) Symbolic Orientation, (2) Cultur.'il Deter- 
minants, and (3) Modalities of Inference. The area of Symbolic 
Orientation provides us with information on an individual's 
preforonco regarding attainment of meaning. Questions attempu 
to ascertain whether the individual prefers to road or listen when 
Gttcmpting to gain meanings Additional items in this category 
provide clues regarding riie individual's feelings, commiimDnts , 
and values and arc decignod to extract inforiisa tion ve^>'irding: 
(1) how much the individual (a) depends on the senue of smell or 
touch in de]"iving meaning, (b) cmpathix.es wi(h others; (2) tlie 



n 

extent to which the j.ndivldual. obeys rules; and (3) the individual's 
ability to employ gestures in speaking, etc. 

In the area of Cultural Determinants, items aire dosigned 
to evaluate whether an individual relics on his own ability to 
analyze a given situation or seeks eissistance from affiliate 
social groups (associate vs. family). This enables the staff to 
assess the person's individuality and his preference for grouping 
procedures. 

Analysis of responses to the items in t.he area of Modalities 
of Inference provides the staff with data regarding how the 
individual processes new information. The items are designed to 
reflect wliether an individual chooses to classify, differentiate, 
seek multiple relationsliips (i.e., to find unified meaning among 
a number of dimensions), or adhere to existing rules in deter- 
mining a given course of action. 

^ Th,e instrument as presently developed is comprised of «'i set 
of cards, each containing one statement which tlie individual can 

citlier read or insert in the language master so that the card is 

read for him. There are eight statements for each cognitive area, 

making a total of 208 statements to which hv must respond. Subjocls 

are requested to respond to each item by placing each card in a pile 

categoriiicd as either Most of l li e Ti me, Some o f th e Time or llajlcHj^ 

Kver. By having the students place the cardn in plJe^i rallier thaii 

use some form oC answ(M: sheet, a great deal of confusi.on has been 
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eliniinalcd which can result when students arc learning how to mark 

rc£;ponso.s on answer sheets. 

From these data, the staff, in conjimcLion with each individual, 
establishes a program of instruction based on the individual's major 
orientations in the throe areas previously described, (A further 
description of this instrument is described in the sections Profile of 
Students and Instrument Evaluation). 

Obloctlvo 3 t llie selection and field testing of standardiiicd 
instruments to be used with the sample population. 

All of the students who enter Adult Education Trograins go through 
an intake process. This process in New York State requires the 
administration of the California Achievement Test. This test pro- 
vides both a reading and math score. The staff also has available 
other diagnostic tools .ns well as other standardi^ed tests which 
might be used to tesn the areas of "theoretical knowledge i.n... verbal 
analogies, verbal listening, reading comprohonsion , grammar .. .math- 
ematics computation, and auditory discrimination as related to 
nia thematics" - however, tliose instruments wore not field^ tested for 
"validity." 

Objective A. The enabling of staff members to place new students 
in the modes of instruction consonant with his/her cognitive style. 

The accomplishment of this objective paralleled the 
accomplishment of Gbjectivo 1. Objective 1 described the 
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staff development progrnm of llio project. The accomplishinent; 
of this objective facilitated Objective 4, in tliat after the 
Niagara Falls staff had received the in depth Lraininy required 
to administer, interpret and prescribe educational programs 
based upon the students responses on the CSM questionnaire, 
they were then able to place students in programs that were 
assumed to facilitate success by the students. 

Objective 5 . Tne assessment of existing; materials in 
the 0-4 grade level available in the Niagara Falls Center. 

Perhaps one of the most valuable aspects of this 
program was the assessment of the Instructional Materials 
available in the Niagara Falls Center for the type of cognitive 
mode that is required for their proper utilization. During 
this process each pi-ice of material was liandlod by several 
members of the staff. The material was classified into 
hardware and softv;arc. For those materials that required the 
students to listen and observe., such as video tapes, each piece 
was viewed. The staff then answered the questions or did the 
activities that were required and then classified the task 
into what skills v;cre required. In this way, not only was 
each piece of material classified, but it was also evaluated 
and tcacliors were able to become familiar with its contents and 
the best procedures for its utilization. All too often, good 
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materials are not used because teachers have not hod tlio needed 
in-service proyraras which help Lhem to know both how to use 
available materials but also which ones are the best to select 
for a particular purpose. The accomplishment of this objective 
was an extremely important aspect of this project. 

Objective 6 . The identification and investigation of 
alternative programs used in other areas. 

There was, of course, an awareness developed of other 
existing programs, particularly in New York State and in the 
Region. However, the focus of this project has not been to 
study these pr^'^rams in depth. It is probably more accurate 
to say that other Regions have bc'come more aware of the 
alternative program which is in development in Niagara Falls. 
Tlie major reason for this was that the complexity of the 
development of the instrument, iv^apping and prescribing instruc- 
tional program for students and, the major task of classifying 
and identifying tlie materials available in Niagara F^lls 
according to the cognitive modes they require for successful 
use v.»as a monumental task. 

The State Education Dopartmcnl, however, was particular- 
ly helpful in identifying other availal)]o programs for Niagaira 
Falls and constant communication between Niagara Falls, the 
State Fducation Dcnartm,Gnt, and other interested p::rlics did 
facilitate the accomplishment, of this objective. 
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Obioctlvc 7 > The dcvolopmont of a list of waicrials which 
would be used in each of tho modes. 

This objective was accomplished in the following way. 
For each of the modes, the Niagara Falls staff suggested 
materials that could be of use with that student. For example, 
if the student had a major TAQ, materials which could include 
the tape recorder, cassettes, records, language master would be 
suggested. In addition, recommendations v/ould also be made 
regarding whether the student would profit more from working 
in groups, (including small groups) or whether the student would 
profit more working individually. 

Objective 8 , Conducting pre-service and in-service programs 
for the purposes of becoming, familiar v;ith alternative programs 
and materials. 

To date, the p'lre-service and in-service programs have 
been primarily for the Introduction and implementation of CSM 
procedure. An inherent part of this procedure, however, is 
the prescription that is written for each student based upon 
his preferred style. As was mentioned in the discussion of 
Objective 7, the staff prepared a list of recommended materials 
for each mode as well as suggestions for instructional pro- 
cedures. Most, if not all, of the materials on this list can 
be found in AUK centers or arc easily available to them. 

Objecti ve 9 , Utili5:ation of Croft materials as the 
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basts of in-service and pre-soi*vicc worksliops to assist in 
understanding reading skills and activities. 

The Croft materials were not an integral part of this 
program. 

ObjcctivG 10 . Recruitment of more target people. 

This aspect of the program v;as not directly observed; 
however, the accomplisliment of this objective is reflected in 
the sample population. 



Sample 

One of the objectives in the program was to reach students 
who fit the categories identified in the 309 grant, as: 



1. Young males 

2. Minorities 

3. Those witH a fourth grade or less ability in reading^ 
writing, computational and communication skills ^ 

4. Welfare recipients 

5. Rural or urban adults 

6. The most severely impoverished 

7. The most severely uadereducated 

8. The unemployed 

9. The underemployed 

Tables 1-3 provide a description of tlie demographic character- 
istics of i*ace, sex, educational level, pre-reading and pre-mnth 
scores of the students involved in the project. As can bo seen 
from the tables, the sa^nple consisted of 103 males and 54 females. 
Of this group, 82 were Black, 73 were white and 3 wore Spanish 
surname. Thirty-nine of these students were in the 0-0 edu- 
cational level (educational level reEer?; to the higl\csl grade 
completed) and 114 students were in the 7-^12 educational level. 
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In Niagara FalLs, t.lio pro-roadinc scores rnngcd from 0-8*9 
years. Pro-reading and prc-nuiLh refer Lo tlic scores ohtainod by 
the students during the intake process on the California 
Achievement Test [cAtT] It should bo noted tliat of the 123 stu- 
dents in Niagara Falls, 109 had a reading level between 0-6.9. 
It is interesting to compare tliese scores witli the pre-math scores 
vhich are somewhat higher and range from 0-10.9 years. In this 
category, of the 102 students .for whom tliis information v;as 
available, 59 students has computational skills in tlie 0-6.9 level. 
These data arc descriptive only and indicate that it is possible 
to recruit students in the category as specified in the target 
population. They should not, however, bo used as comparative 
data between centers (see evaluation section) e 
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PROFILFi OF STUDENTS 
There arc throe umjor areas in which studcnLs are 
' nuipped; Symbolic Orientation, Cultural Dotcrnnnants , and 

Modalities of Inference. The first area, Symbojic Orientation, 
refers primarily to how an individual processes infonnation. 
That is to say, does he appear to obtain information better 
through auditory, or through visual means. (Other areas are 
also included on the CSK questionnaire, however, the data 
breakdown were included only for auditory or visual means only). 
The question of how one obtains information best is asked for 
quantitative areas as well as linguistic areas. The second 
area. Cultural Determina nts, refers to how an individual 
mediates the information he receives; does he prefer to work 
things out on his own or does he instead work things out based 
* on discussions with his family or friends. The third area, 
. Modalities of Inference , refers to how the individual in- 

corporates this information into his cognitive structure so 
that. he is able co make decisions and act utili?:ing the 
Information he has gained. 

Figures 1-11 provide a breakdown of those students in Niagara 
Falls who had a major orientation in each' of the described modes by 
race,'*^ educational level and sex. A major orientation is define<^ a 
those students who received a score greater than 24 for any of 
the defined categories. " (The highest posisible score is 40 and 
the lowest possible score is 8). It is probably debatable 

"^The data \/oro not analy/.ed for those respondents who were 
catcgoi'iJ'.cd as Spanish surname or Oihcc because clie sample was too 
• small. In all cases the combined N was no larger than 3. 

ERIC 



whether a «core .of * nclunlly reflects a major orientation > 
but it certainly does reflect a mode which the student describes 
he uses more frequently than not. 

S ymbolic Orientation 

The first mode depicted in the Symbolic Orientation 
area is Thoorelical Auditory Lingu istics, T(AL) • This mode 
refers to the "Ability to acquire meaning through hearing spoken 
words." (This definition as well as the other which will be 
used are taken from the Niagara Falls Cognitive Style Mapping 
Analysis Sheet, See Appendix 1 )• A total of 72 students 
received a score of 25 or more on the responses which tap this 
particular mode. This represents 58,5% of the total sample. A 
' further breakdown- irhow<c that V\ or 27.6% of the total Black 
sample had a major T(AL). This represents 22 males and 12 
females. Thirty-five of the total sample were white. This 
represented 24 nvalcs and 11 ferneries and reflected 28,5% of the 
. total group. 

This is a particularly interesting mode because one would 
assume that most people who wore in AWJ programs would have to 
rely on this particular mode to a great extern, bocaiu^e of their 
lack of rending skills, and yc\t when w.o analyjco l.he data we find 
only 8 people out of a total of 14 in the 0-6 grade level who 
describe them.iolvcs as using this mode frequently. This may he attr 
buted 10 the fact that people responded lo a mode Ihey would prefer 



28 



o 



CO 

M 
O 



O 

to 



0 

60 
•H ! 

< 



u 

4J 
0) 

o 
c» 

H 



rn 












f1 






O 


1 




•H 






4J 










II 


u 




;j 


> 




*o 








•J 





23 



ERIC 




.19 



> 



o 

U 
CO 

a 



o 



O 

•rt 

rl 
<U 
•H 

O 



4- 

4J 

•H 
w 

4J 
O 

<U 

.O 
O 

d 
:< 
o 

W) 
•H 
(^4 



24 

« 

use rather than one they actually utilized. 

The second mode in the Symbolic Orientation area is 
the Theoretical Audit o ry Quantitative , T(AQ) and is displayed 
in^ figure 2, This tnode reflects the '^Ability to acquire meaning 
from numerical symbols, relationship and measuroinonts that are 
spoken," People who use this particular tncde v;ould more frcquent- 
ly understand math problems when they v;ere explained orally as 
opposed to visual or written explanations. 

Of the total sample, 75 people describe this as being 
true of them most of the time. This represented 61% of the 
total group. Of these 75 people, 36 were Black and 37 were 
white. It is interesting to note that the number of respondents 
In the 0-6 age group is again very small. More Blacks, in this 
educational group, hov;ever, depicted themselves as using this 
mode more frequently than did the white respondents, (Seven 
Blacks had a major T(AQ) while only two v;hites described 
themselves as having a major in this area). 

The next mode. Theoretical Visual Linguistics , T(V7j), 
appears in Figure 3, This mode refers to the "Ability to acquire 
meaning from words that are seen. Indicates some who reads with 
an above-average degree of comprehension," An obvious difficulty 
with this definition is the lack of specificity regarding wliat 
above-average comprehension means. If talien purely at face 
value, it may mean the ability to read at a tenth grade level 
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or- above, since this is the reading* level required by a large 
number of jobs. (StiLcli 1969). It may, liowever, reflect 
above average reading level for tlie students age/grade. For 
example, if a fourth grade student read at the fifth or sixth 
Igrade level this could be described as reading v;ith above average 
comprehension. Although the definition lacks clarity, the intent 
was clearly to describe a person who gains most of his information 
through reading. 

As can be seen from Figure 3, 56.1% of the respondents 
characterized themselves as utilizing this method most of the 
time. Of this group, 37, or 53.6% were Black,, while 29, 
which represented 42.1%, were white. As would have been 
expected, the bulk of those indicating that this was a major 
mode for them were in the 7-12 educational .level. Those stu- 
dents in the 0-6 grade level were probably responding to the 
mode they would prefer to utilize most. 

Those students with n major ThcorcLical Visual Qua nt itati ve, 
T(VQ) , can be found in Figure A. T(VQ) refers to the "Ability 
to acquire moaning from numerical symbols,, relntionship and 
measurcmcMiLs that arc seen." This, of course, is quite similar 
to T(AQ) except in this category meaning is perceived more 
quickly from visual stimuli. Sixty-eight of the respondents 
categorized themselves in this manner. This reflected 55.3% of 
the total sample. One would again. expect students in the lower 
grade levels to use tliis mode hT^s frequently than stitclonls in 
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the higher grade levels, and t;his is reflected in the di.splay. 
Only nine of the l/i students in the 0-6 grade level said thcije 
Items were true for them most of tlic time* 

Cultural Petcnninants 

This next section describes the breakdown in the Cultural 
Determinants Area . 

The first mode described is Associates (See Figure 5). 
Associates is defined as representing those perrons who "seek 
meaning tlirough interaction with associates One lialf, 50.4%, 
of the students described themselves as relying on Associates 
(A) when making decisions. Knowing this kind of information is 
very important in understanding hov; an individual processes 
information and it can help one in desigiiing instructional 
programs for students. A person in this category will usually 
ask the advice of friends, cohorts or work associates. A 

student such as this likes to arrive at decisions througli discussions 

with classmates and will do well in small groups, lie most definitely 

would not prefer to v;ork al9ne. 

The next mode in the Cultural Determinants arc-a is Family. 

This mode refers to how much the individual relies on his family 

when making decisions and processing information. This is an 
interesting area because more females said tiiis was true of 

them most of the time than they did in any other mode. (See Figure 6) . 

33 females liad majors in this area as compared to 19 in tho Associates 
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and 29 in the Individuality area. In general, the respondents 
who fit this category represented 62.6% of the total sample and 
the number of Blacks and whites were about even. The data do 
not give us any clues as to why there were, ivore women in this 
area, however, one might speculate that it may be due to the 
socialization process. 

The next area, Individuality , indicates that a person 
'•seeks meaning independently." It is interesting to compare the 
data on I ndividuali ty with that on Family . In this area 76% 
of the total sample said that this was true of them most of 
the time, (See Figure 7) Blacks and whites were again quite even, A5 
and A6 respectively, and women again were well represented (29) al- 
though not to the extent that they were in the Family area. 
What is mbre interesting, however, is to look at the data 
in the 0-6 educational level. In this group there were no 
Black males who said th;U they arrived at their decisions 
primarily independently, wherea5; in this same educational group 
there were no white females that characterized themselves as 
using this mode inost of the time. These differences may be 
accounted for in that many Black women in this group are 
frequently heads of households and must make decisions indepondent- 
ly or rely on Family Cor assistance, whereas most white women in 
this group are generally homemakers and may tend to leave the 
primary decision making up to cither husbands or other family 
members . 
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Modalities oC InCorenco 

-The first section cvnlucitod in the area of Modalities of 
Inference is called Ma<'.nitude . tegnitude refers to "A tendency 
to use norms, rules or categorical classifications as tlie basis 
of one's decisions (e.g. persons who need to define things in * • * 
order to understand thorn)/' The breakdovm for these data, shown 
in Figures, indicate that 98 respondents, which represent 78% 
of the total population, describe themselves as using this mode 
of information processing most of the time. This figure is 
composed of 39,8% Blacks and 37.4% whites and is higher than any 
of the other categories in this section. Fifty-eight males and 
37 females were in this category. 

If wo were to compare this particular mode with Bloom's 
Taxonomy, we would probably classify it among the lower levels 
in the cognitive hierarchy. This is significant, because of the 
kinds of tests in which students who score higher in this are^ 
would do best. On examinations where definitions are required, 
or items which require strict identification of rules, a stu- 
dent who uses chis particular mode most frequently would do 
well. On other typos of tests which require more evaluative 
skills, those students would do less well. 

The second area in Modalities of Inference is labeled 
DiCfcroiico . Difference ir. defiiiod as "A tencioiicy to reason 
in Lorms of one-to-one contrasts or coinp.'irison;; , perccivfn 
what a conco|>t.is by wliat it is nol. Tends to bo very creative 
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(e.^g. P9CLS, artists, and inventors) • llicsc data arc displayed 

in Figure 9. Sixty percent of: the total population described 

themselves as using this mode most of the time. Of this 60,97#, 

30*95%were Black and 27*67^ were white. This figure reflects 

the responses of males and 28 females. 

The third mode in Modalities of Inference is described 

R^^ l ^ttionship . Relationship is defined as '^A tendency to 

perceive meaning through the identification of relationship 
(e.g. someone who uses analogies and examples),*^ A total of 50 

people described themselves in this manner. (See Figure 10) Tliis 
represents only Al% of the total population and includes the responses 
of 20 Blacks and 28 whites. Only one of the Black and 4 of the 
whito respondents in the 0-6. educational level described 
themselves in this manner. One probable reason that the per- 
centage of respondents is lowest in this category is that this 
mode requires the most complex skills and one would not expect 
large numbers of people in ABE programs to utilize these skills 
most of the time. Indeed, one v;ould not expect large numbers 
of people in general to use this mode most of the time. 

The last mode analy/.ed was Appraisa l. This mode is 
defined as "A tendency to om.ploy all metliodi^ of i.nference (M,l), 
and H) , giving equal weight to each, when reasoning." Seventy- 
nine people, wlio represent 6A.27o of the total population,*^ said that 
they used a combination of moans to^/irrive at solutions; to problems 
most of the time. (See Figure 11) Th.is is piobably true oC most of 
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us, but what is difficult to ascertain is tho degree to which 

we apply these methods equally, or whether or not the need to 

apply each of tliese methods equally is required for each 

situation* It would seem reasonable that different situations 

would require different approaches and, the more sophisticated 

♦ 

stu<f^nts could ascertain what was required in each situation 
and have the skills available which would allow them that 
flexibility • 
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INSTRUMENT EVALUATION 
Two different procedures were used to evaluate the 
Cognitive Style Mapping (CSM) Questionnaire that was develop- 
ed by the Niagara Falls Adult Basic Education Center. The 
first procedure was to provide information on the reliability 
and validity of the instrument. Reliability refers to 
whether the results of the instrument are stable over.a period 
of time. This means that if a test were taken at x point in 
time, the results would be relatively the same at ^ point in 
time. This implies, of course, that np intervention takes 
place during the intervening period. This information * is 
extremely important if you were going to develop an instruction- 
al program based upon a person's cognitive style; the results of 
the questionnaire has to be an actual representation of that 
style. In order to ascertain this, the instrument was field 
tested on a group of High School students in Niagara Falls. 
Seventy- two students were administered the instrument in early 
October, 1974. During the third week of November, all of those 
students who had participated in the initial testing were re- 
tested. 

*The directions to the sttidonts in both situations were 
that (1) the questionnaire was not a -test and, (2) that thoy 
were Lo separate the cards they received according to the 
applicability of the slaLomenl to their own learning style. 
Cards were then inserted Into a Language Master which **road'* each 
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statcmouL, By using the LanguaRO Master, students were provided 
with both a visual and auditory stimuli. Each student was directed 
to place the language master card in a box labeled '^MOST OF THE 
TIME" if the statement described behaviors or feelings that were 
true for him most of the time; "SOME OF THE TIME" for those 
statements that reflected how he was some of the time; and "lI/vRDLY 
EVER" for those statements v/liich described behaviors or feelings 
that he hardly ever had. 

An examiner worked with each student until the procedures 
were clearly understood. In addition, directions were given 
that no cards were to be skipped. The exercise was not timed, 
but the students were requested to spend only a few seconds on 
each card. The student was permitted to put the cards through the 
Language Master as many times as was felt necessary. 

A "t" test was used to compare the pretest scores with 
the posttest scores. A "t" test essentially compares the means 
of two groups to ascertain if there are significant differences 
between dveStwo scores. When the data were compared no significant 
differences v;ere found between the pretest and the posttest scores. 
This means the lest scores remained pretty much the same over the 
four week period of time. In other words, if a student initially 
had a major TVL his score A weeks later also reflected this. Those 
results, however, do reflect group data and do not represent 
individual data. Consequently, while it is true that for 
the group as a whole, test scorer, rem;iinad relatively the stmo ^ 
'for a particular Individual there may have been some shifts. 
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The instrument was also carefully scrutinized for content validity • 
When looking at content or lace validity wo are looking to see if the 
items appear to test those qualities whicli they are supposed to test. 
This was a most difticult task, although most of the items appeared 
to have face validity. However, a factor analysis wa« performed to 
ascertain whether all of tlic assumed 26 variables were present and 
also to. determine if tiie questions that were given in each area, 
actually tested that particular mode. The following discussion by 
Williams (1968), of the function of factor analytic procedure, pro- 
vides an excellent rationale for using this particular statistical 
approach. '\..we can view measurement overlap as the extent to 
which measures of different variables are measuring something in 
common. Factor Analysis is a mathematical procedure applied for 
this purpose; it aids us in answering the question; Given a 

relatively large number of variables, docs their measurement 

« 

overlap indicate that there may be fewer, more basic and unique 
variables underlying this larger number? Factor-analytic pro- 
cedure takes the variance defined by intercorrelations among a 
set of measures and attempts to allocate it in terms of fewer 
underlying hypothetical variables. These hypothetical variables 
are called factors." 

Table 4 shows the results of the factor analysis. Two 
things can be clearly seen from this table. (1) There are not 
26 factors measured, at best tliere are 18; however, 68% of the vari- 
ance is accounted tor by the first "l3 factors, with the first factor 
counting for 16.5% of the variance and the second factor, 11. 2% of 
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the variance which ciimulativoly account for 27% of the variance* 

When viewing Table /i you will sec that some of the 
correlations have a negative (-) sign in front of thorn. For 
those numbers without negative signs, the relationship between 
the variable and the factor is positive. The negative sign 
indicates a negative relationship between the variable and the 

factor. 

There is apparently a great deal of overlap in what the 
variables measure. The table is designed so that you can see 
which questions (variables) load highest on each factor and 
the mode to which each v;as originally attributed. (A definition 
of each of the modes appears in the Appendix). There has been 
. ^ no attempt to rename any of the factors, hovovor, an effort in 
this direction is clearly needed. 

Six modes T(AL), T(AQ) , Q(A), A(V), F, and R do not 
appear in the factov analysis as loading liigh on any factor. 
When reexamining the instrument tor modifications, this should 
be taken into consideration, and questions in these areas should 
either be deleted or rewritten, if it is felt th.at information 
in these areas is indeed required. 



ERIC 



57 



52 

PRODUCT EVALUATION & SUMMARY 
Tlio cvalualion design scaled in the proposal is: 

1. Tl'iG diffcrcncG beLveen pro-post test scores 
will be calculated and the percentage of 
students who gain 1.0 grade equivalents or 
more will be calculated. 

2. The results of the pre-post testing will 

be analyzed for statistical significance using 

a real gain vs anticipated gain design. 
In an attempt to evaluate the success of utilizing the 
CSM procedure, Schenectady, Uliite Plains, Albany and Buffalo were 
recruited to assist in the implementation of this aspect of the 
program. After having received extensive training (previously 
described in the objectives section) each was requested to identify 
two groups of students (10 students in each group). The first 
group of students were to be characterized as the experimental 
group and were to be mapped, prescriptions provided and instruc- 
tional procedures utilized based upon the information gained. 

The second group, described as the control group, were to fit the 
target population specifications but would receive instruction as 
is normally provided in each center. After one hundred hours of 
instruction (the number of hours as modified and approved during 
the inter Lm evaluation) utilizing the previously descvi]>od pro- 
cedure, tlio students in the experimental group were to be compared 
to students in the control group on the basis oC pre-post test 
Rcoros. * 
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This aspect of the program was not entirely iiiiploniented. 
The above named sites did select groups of students with which 
to work, they were mapped and prescriptions were made. This, 
however, took place late in the year due to the extensive v;ork 
required for staff development in Niagara Falls and for the partici- 
paring sites. Consequently, the length of time that the program was* 

implemented was not long enough to warrant evaluation and 
analysis of comparative data. The staff in all sites are now 
presently skilled enough in tlie concept and use of the CMS pro- 
cedure that this objective is now feasible for next year and 
has been included as one of the recommendations. 

An evaluation form was completed by each of the directors 
in the participating centers.' Their comments have been summari:ced* 

1. The directors felt there v;as no problem in getting 
students who fit the target population. 

2. Tlie program was implemented primarily in the instructional 
labs by the lab r>pocialist. A major problem for 

some centers, however , was the lack of materials 
which fit all of the specified modes, particularly 
in the 0-2 reading level. 

3. The directors report tliat students appeared to be very 
positive about the process and increased rapport seemed 
to develop between the students and the teachers as a 
result of this project. -Many of the students report- 
edly liked the personal attention and perceived tlieir 



54 

teachers to be more interested in them and their 
leaxniny process. 

4. Tlie directors noted that additional staff would 
probably be required for effective implementation. 

5. All felt that CMS was a valuable procedure for 
both the staff and the students and felt that the 
program should be continued. 

SufTiirtary 

The project in Niagara Falls should actually be con- 
sidered as a pilot project. The staff did .an outstanding job in 
accomplishing the majority of a large number of very complex 
objectives and, it was not possible given the time they had, to 
have p7;ovidcd comparative data. This refer? primarily to the 
product objective whereby che success of the project would be 
evaluated by gain scores. This seems a reasonable object ivn 
now, but ncX: previously . 

The Niagara Falls group have become skilled in the theory 
and application o£ CMS and have trained personnel in other centers 
as well. They developed a most complex instrument and, although 
modifications need to be made, it appears to be useful in assess- 
ing preferences of strdcnts -learning styles. 

The utilisation of this instrument not only appears to have 
resulted In positive altitudes of the student?:, but also positive 
attitudes on tho part of tlic, staff, and this is a tremendous benefit 
in any program. 
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The completion of the evaluation and categorization of the 
instructional material in the 0-6 level available in Niagara Falls 
Is not only a benefit to the statf but could also be an important 
document for all ABK centers. 

In conclusion, specific recommendations follow for 
improvement of the program, however, in terms of what has been 
accomplished this year, the project can only be described as 
highly successful. This success can only be attributed to the 
excellent administration of the program and the highly pro- 
fessional and diligent work of the staffs 

Recommendations 

1. An evaluation of.CSM relative to achievement gains 
needs to be made. The cognitive mapping procedure, prescrip- 
tions and instruction should be utilized for a period of not 
_less than 200 instructional hours and then accurate pre and post 
test gains should bo evaluated. The scores should be evaluated 
to the test scores of a control group drawn from a random 
sample of students involved in ADE programs statewide. (It is 
understood that. a record is kept by the State Education Depart- 
ment of all entering students* initial test scores and placement 
as well as hours of instruction and follow-up test evaluation.) 
It is from these data that it is recommended that the sample be 
drawn . 

2. A sorting out of actual hours when the implementation 
of instructional procedures v;hich facilitate the utilisation of 
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a student's preferred cognitive stylo are in process is required. 
For example > if a student is in attendance at an ABE center for 
four hours a day (1) Wliat time is actually allotted for actual 
Instruction in the student's preferred mode and -(2) What is the 
actual time spent in reading instruction and/or reading related 
activities? 

3. If other centers are to be used as part of the 
experimental group in which you will compare gain scores to 
students who have not used this procedure, a close monitoring 
for actual use of cognitive strategies should be made. For it 
is only in this way that reasonable cause and effect relation- 
ship's can be suggested. 

4. Greater emphasis needs to be placed on helping 
teachers utilize instructional materials wh.ich require 
cognitive styles v;hich are compatible with those preferred by 
the student and loss emphasis .needs to bo placed on the instru- 
ment. The instrument itself in some cases appeared to over- 
shadow the purpose for which it was designed - which was 
e^^dntially to provide information which v;ould improve the in- 
structional program of the students. It is this purpose, 
designing a more efficient instructional program for students > 
which should be highlighted. 

5 a. Presently , the instrument is very lengthy and time 
consuming to both administer and to score. Since the information 
derived from the Factor Analysis (See section on Factor 
Analysis) indicated that (1) not all 26 Factors were present and 
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(2) some qiKiSLions tapped a particular area bettor than others, 
it is roconiniendod tlint the instrument be shortened. 

5b. In many cases, items which were considered to have 
tapped a particular mode actually fell in another area, it is 
suggested that some reconsideration be given to the labeling 
of some modalities. 

6. Development of in-service programs which will help 
teachers become aware of what modes students need to develop in 
order to be successful in the tasks that are required of them 
and to assist them in developing strategies which can be 
utilized to help students make the transition from their pre- 
ferred modes to other modes as they are required should be 
•instituted. 

7. An evaluative questionnaire to obtain students* 
perception of the program needs to be developed and adminisLcrod 
after the 200 hour block of instruction. 
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ArJiilL hanh: KducaLlon 
Nlaijara Fnlln, Nt-w York 

■ . . ^ . COGNITIVE STYLE MAPPING 

•* 


X 

> 

1 




SYMBOLS : 


DEFIillTION'S 


Oiru; 
Pi 


]n:ATic 

O 

M 


'1 

MS ? 

5 

-.1 


T(AL) 

Theoretical Auditory 
Llnguiotlcs ' 


Ability to acquire meaning through 
hearing spoken words. 


* 




ii 




T(AQ) 

Theoretical Auditory 
Quantitative 


ADixiry to accjuire □^Uiixii^ llkj^ 

nur.erical symbols, relationship and 

neacurements that are spoken. 
* 








TCVL; 
Theoretical Visual 
Ling^uictics 


AK-fl^fv f*n nnnn"lrp neanir5£ fro!i vords 
tb^t are seen. Indicates scz;eone who 
reads with an above-average degree of 
coi^prehension. 


■ 




1 

1 ) 
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T(VQ) 
Theoretical Visual 
Quantitative 


Ability to acquire meaning froji 
nuTjerical syn^bols, relationship and 
measurements that are seen* 






I 




• 




1 
( 

1 


Q(A) 

Qualitative Auditory 


Ability to perceive meaning through 
the sense of hearing. Can ciistinguish 
betvcen sounds, tones or music, etc. 


1 

{ 




i 
f 


Q(0) 

Qualitative. Olfactory 


Ability to perceive meaning through 
the senJse of smell. 


1 




1 


Q(S) 

Q\v2ii:ative Savory 


Ability to perceive meaning- through 

the sense of taste, , 


1 




V 

f 

1^ 


1 

• y 
:^ 

1 
ER 


Q<T) 

Qua lien live Tactile 


Ability to po.rceive meaning through 
the Sctnse of touch. 
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Q(V) 

Q-j^iiintivc Vlsnial 


Ability Lo percoive meaning through 
tho f;on;ui of sight , 


1 
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SYMBOLS 



Q(r) 

Qualitative Proprio- 
ceptive 



Q(CES) 
Qualitative Code 
Eothetic 



Q(CET) 
Qualitative Code 
Ethic 



Q(Cll) 
Qualitative Code 
lUctrionic 



Q(CK) 
Qualitative Code 
Klnesics 



Q(CKH) 
Qualitative Code 
Kluaothetic 



Q(CP) 
Qvialitative Code 
Proxe^ics 



Q(CS) 
Qualitative Code 
Synnoctico 



Q(CT) 
Qualitative Code 
•^--^-ict lonal 



Q(Cn4) 
Qualitative Code 
Enpathetic 



DKFIHITIONS 



Ability to cf)ordlnntft a number of behavioro 
elaultaneouely in order to perform a complex 
taek* Indicateo eoraeonc who uaca initiative 
and intuition (a sixth oenoe) e.g. playing 
the piano, dancing to rock mualc, typing 
fron a dictaphone, running an efficient 
office. 




Senoltlvity to the ideas and feelings of 
others, ability for oor:eone to put hinself 
In another person's place. 



Ability to enjoy the beauty of an object 
or an idea. 



Cormitcent to one's o\m oet of values, a 
group of principles, obligations and/or 
duties* This corcnitnent need not Icply 
Eorality • 



Ability to perceive eiq^ected behavior and 
act it out. 



Ability to understand and use body language 
(e.g. the use of facial expressions). 



Ability to perforin notor skills according 
to a reconnended or acceptable fora (e.g. 
bowling, golfing). 



Ability to judge phyolcal and social 
distance between oneself and another. 



j Ability to know oneoclf . 



Ability to develop rapport with others, and 
thereby influence then (e.g. oalos rcpre- 
oontatlvc , hootetm , reccptlonlot . ) 
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MAP 

SYMBOLS 


DEFINITIONS 


UUJI 

i 

U 
O 


• NTATl { 

0 

c 
X 


m 1 

1 » 

o 


A 

Associates 


Sceko ceaning through interaction with 
aosociatee . 






P 

Fanily. 


Seeks meaning through interaction with 
fanily. 








I 

Individuality 


Seeks- ceaning 
independently. 












M 

Magnitude 


A tendency 'to use noms, rules or categorical 
classifications as the basis of one's 
decisions (e.g. persons who need to define 
things in order to understand thea) . 






1 


D 

Difference 


A tendency to reason in terms of one-to-one 
contrasts or cor:parisons, perceives vhat a 
concept is by v^hat it is not. Tends to be 
very creative (e.g. poets, artists, and 
inventors) . 






k 

1 


R 

Relationship 


A tendency to perceive meaning through the 
identification of relationship (e.g. sone- 
one who uses anologies and ejcamples) . 








L 

Appraisal 


A tendency to craploy all methods of 
inference (M, D, and R) , giving equal weight 
to each, when reasoning. 
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